SINGULAR TRAJECTORIES OF CONTROL- AFFINE SYSTEMS 
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Abstract. When applying methods of optimal control to motion planning or stabilization prob- 
lems, some theoretical or numerical difficulties may arise, due to the presence of specific trajectories, 
namely, singular minimizing trajectories of the underlying optimal control problem. In this article, 
we provide characterizations for singular trajectories of control-afHne systems. We prove that, under 
generic assumptions, such trajectories share nice properties, related to computational aspects; more 
precisely, we show that, for a generic system - with respect to the Whitney topology — , all nontrivial 
singular trajectories are of minimal order and of corank one. These results, established both for 
driftless and for control-afBne systems, extend results of As a consequence, for generic sys- 

tems having more than two vector fields, and for a fixed cost, there do not exist minimizing singular 
trajectories. We also prove that, given a control system satisfying the LARC, singular trajectories are 
strictly abnormal, generically with respect to the cost. We then show how these results can be used 
to derive regularity results for the value function and in the theory of Hamilton-Jacobi equations, 
which in turn have applications for stabilization and motion planning, both from the theoretical and 
implementation issues. 

1. Introduction. When addressing standard issues of control theory such as 
motion planning and stabilization, one may adopt an approach based on optimal 
control, e.g., Hamilton-Jacobi type methods and shooting algorithms. One is then 
immediately facing intrinsic difhculties due to the possible presence of singular tra- 
jectories. It is therefore important to characterize these trajectories, by studying in 
particular their existence, optimality status, and the related computational aspects. 
In this paper, we provide answers to the aforementioned questions for control-afhne 
systems, under generic assumptions, and then investigate consequences in optimal 
control and its applications. 

Let M be a smooth (i.e. C°°) manifold of dimension n. Consider the control-affine 
system 



where x G M, to is a positive integer, (/o, . . . , /m) is a (to A- l)-tuple of smooth vector 
fields on Af , and the control u — (u\. . . . , u^) takes values in an open subset of 
M™. For xo e M and T > 0, a control u G L°°([0, T], rj) is said to be admissible if 
the trajectory x{-,xo,u) of (S) associated to u and starting at xq is well defined on 
[0,T]. On the set Uxq.t of admissible controls, define the end-point mapping by 

Exo,t{u) := x{T,xo,u). 

It is classical that Uxo,t is an open subset of L°°{[0, T], 51) and that E^a^T '■ ^xo,t ~* M 
is a smooth map. 

Definition 1.1. A control u e Uxo,t is said to he singular if u is a critical point 
of the end-point mapping Ex„,t, i-e. its differential atu, DExg,T{u), is not surjective. 
A trajectory a;(-, Xq, u) is said to be singular if u is singular and of corank one if the 
codimension in the tangent space of the range of Exo,t{u) is egual to one. 
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In other words, a control u G hixo,T is singular if the linearized system along 
the trajectory x{-^xo,u) is not controllable on [0, T]. Singular trajectories appear as 
singularities in the set of trajectories of (E) joining two given points, and hence, they 
play a crucial role in variational problems associated to (E) and in optimal control, 
as described next. 

Let and xi be two points of M, and T > 0. Consider the following optimal 
control problem: among all the trajectories of (E) steering xq to Xi, determine a 
trajectory minimizing the cost 

Cu,c.,giT,u)^ j (^-u{tfU{x{t))u{t)+a{x{t)fu{t) + g{t,x{t))yt, (1.1) 

where a = (ai, . . . , a™) G C°°(M,R"), 5 e C°°(R x M), and U takes values in the 
set of symmetric positive definite m x m matrices. 

According to the Pontryagin Maximum Principle (see ]2l|| ), for every optimal 
trajectory x{-) :— x{-,xo,u), there exists a nonzero pair (A(-),A°), where A° is a 
nonpositive real number and A(-) is an absolutely continuous function on [0, T] (called 
adjoint vector) with X{t) G T*f^-^M, such that, almost everywhere on [0,T], 

dH 

m = -g^{t,x{t),\{t),x'>,u{t)), 

m = -^it,x{t),X{t),X',u{t)), (1.2) 
ox 

— {t,x{t),X{t),X',uit))=0, 

where 

H{t, X, A, A°, u) := M,(A, Mx)) + X" i -u^U{x)u + a{x)'^u + g{t, x) j 

is the Hamiltonian of the system. An extremalis a 4-tuple (a;(-), A(-), A'', u{-)) solution 
of the system of equations (1^). The extremal is said to be normal if A° 7^ and 
abnormal if A" = 0. 

The relevance of singular trajectories in optimal control lies in the fact that they 
are exactly the projections of abnormal extremals. Note that a singular trajectory 
may be the projection of several abnormal extremals, and also of a normal extremal. 
A singular trajectory is said to be strictly abnormal if it is not the projection of a 
normal extremal. Notice that a singular trajectory is of corank one if and only if 
it admits a unique (up to scalar normalization) abnormal extremal lift; it is strictly 
abnormal and of corank one if and only if it admits a unique extremal lift which is 
abnormal. 

For a normal extremal, it is standard to adopt the normalization A*^ = —1, and 
to derive the control u as the feedback function of {x, A) 



uit) = 



(uiit)' 



\U„i{t)^ 



= U{x{t)) 



-1 



/ hi{t) - ai{x{t)) 



\Kn{t) - a,n{x{t))^ 



(1.3) 



for every t G [0,T], where hi(t) := {X{t), fi{x{t))) , for i = 1, . . . , m. In particular, 
normal extremals are smooth on [0, T]. 
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For abnormal extremals, the situation is much more involved, since equations ( |l.2| ) 
do not provide directly an expression for abnormal controls. Abnormal extremals may 
be nonsmooth, and it is not always possible to determine an explicit expression for 
singular controls. Indeed, it follows from (L2) that 



h,{-) = Qon [0,T], z = 1, 



(1.4) 



along every abnormal extremal. At that point, in order to compute the singular 
control, one usually differentiates iteratively ( |l.4| ) with respect to t, until the control 
appears explicitly (in an affine way). To recover the control, an invertibility property 
is then required, which may not hold in general. 

In this paper, we prove that, in a generic context, such an invertibility property 
is obtained with a minimal number of differentiations (cf. Theorem 2.6). This is the 
concept of minimal order, defined in Definition 2.5. Here, genericity means that the 
(m + l)-tuple (/o, . . . , /m) belongs to an open and dense subset of the set of vector 
fields equipped with the Whitney topology. The corank one property is also proved 
to hold generically. We obtain similar results in the driftless case (cf. Theorem [2.16 ) . 

In a preliminary step for deriving the above results, we establish a theorem of 
independent interest, asserting that any trajectory of a generic control-affine system 
satisfies x — almost everywhere on the set where the vector fields are linearly 
dependent (cf. Theorem 2.1). 



When considering optimal control problems, singular minimizing trajectories may 
exist, and play a major role, since they are not dependent on the specific minimization 
problem. The issue of such minimizing trajectories was already well known in the 
classical theory of calculus of variations (see for instance ^) and proved to be 
a major focus, during the forties, when the whole domain eventually developed into 
optimal control theory (cf |10|] ). The optimality status of singular trajectories was 
chiefly investigated in |ll|, |30[] in relation to control-affine systems with m = 1, in 
[0, 18, |l^, regarding driftless systems with m ~ 2 and in 27 1 for general 
nonlinear control systems. 

In this paper, we prove that, for generic systems with m ^ 2 (and m ^ 3 in the 
driftless case), and for a fixed cost Cu_a ,Q, there does not exist minimizing singular 
trajectories (cf. Corollaries 2.£ and 2.19 ). We also prove that, given a fixed system 
(E), singular trajectories are strictly abnormal, generically with respect to the cost 
(1.1) (cf. Propositions 2.12 and 2.21). We then show how the abovementioned results 
can be used to derive regularity results for the value function and in the theory 
of Hamilton- Jacobi equations, which in turn have applications for stabilization and 
motion planning. 

This paper is organized as follows. Section |^ is devoted to the statement of the 
main results, firstly in the control-affine case, and secondly in the driftless case. The 
consequences are detailed in Section ^, and proofs are provided in Section |^. 

2. Statement of the main results. Let M be a smooth, rt-dimensional man- 
ifold. Throughout the paper, VF{M) denotes the set of smooth vector fields on M, 
endowed with the C°° Whitney topology. 



2.1. Trajectories of control-afRne systems. 

Consider the control-affine system 



Let T be a positive real number. 



x{t) = fo{x{t)) +J2Mt)Mx{t)), 



(2.1) 



i=l 



where (/o, . . . , fm) is an (to + l)-tuple of smooth vector fields on M, and the set of 
admissible controls u = {ui, . . . , Um) is an open sub set of L°°{[0, T], f2). 

For every trajectory x(-) := x{-,xq,u) of {2A), define /dop(a;(-)) as the closed 
subset of [0, T] 

/dep(x(-)) {t e [0, T] I rank{/o(a;(t)), . . . , fMt))} < to + 1}. (2.2) 

Note that, on the open subset of M" where rank{/o, ■ ■ ■ , fm} — to + 1, there 
is a one-to-one correspondence between trajectories and controls. In contrast, on 
Idepix{-)), there is no uniqueness of the control associated to x(-); in particular, x(-) 
may be associated to both singular and nonsingular controls. This fact emphasizes 
the following result, which describes, in a generic context, trajectories on the subset 
of R" where rank{/o, . . . , fm} < m -f 1. 

Theorem 2.1. Let m < n be a nonnegative integer. There exists an open and 
dense subset Om+i ofVF{M)"^'^^ so that, if the {m + l)-tuple (/o, . . • , fm) belongs to 
Om+i, then every trajectory x{-) of the associated control- a ffine system x — foi^x) + 
Uifi{x) verifies 

x{t) ^ 0, for a.e. t G /dop(a;(-)). (2.3) 

In addition, for every integer N , the set Om+i can be chosen so that its complement 
has codimension greater than N . 

Remark 2.2. At the light of the previous result, one can choose the admissible 
control u on Idepi^i')) such that, for every t G Idep{x{-)), u(t) consists of any m-tuple 
(ai, . . . , am) so that 

m 

/o(x(0) + ^aJ4a:(i)) =0. 

i=l 

In particular, on any subinterval of Idep{x{-)), the trajectory x(-) is constant, and the 
control can be chosen constant as well. 

Remark 2.3. A trajectory x{-) is said to be trivial if it reduces to a point; 
otherwise it is said to be nontrivial. It is clear that, if Idep{x{-)) ^ [0, T], then x(t) ^ 
for t ^ Idepix{-)) and x(-) is nontrivial. 

Let x{-) be a trajectory of a control- affine system associated to an (m + \)-tuple 
of Om+i- As a consequence of Theorem 2.1, x{-) is trivial if and only if Idep{x{-)) = 
[0,T]. 

2.2. Singular trajectories. Recall that a singular trajectory x{-) is the pro- 
jection of an abnormal extremal {x{-),\{-)). For t S [0,T] and i,j G {0, . . .,m}, we 
define 

h,{t) := (A(i),/,(x(t)), h,,{t) := {\{t),[f,,f,\{x{t))). 
Along an abnormal extremal, we have for every t G [0, T], 

/io(0 — constant, hi{t) — 0, i — l,...,m. (2-4) 



Differentiating (2.4), one gets, almost everywhere on [0,r], 



h^o{t) + ^h^j{t)uj{t) = 0, i G {0,...,to}. 



(2.5) 



Definition 2.4. Along an abnormal extremal {x{-), A(-), u{-)) of the system (2.1), 
the Goh matrix G(t) at time t £ [0, T] is the m x m skew- symmetric matrix given by 



Git)■■^{h.,{t))^<.,<^■ (2.6) 



Since G{t) is skew-symmetric, rank G(t) is even, and Equation (2.5) rewrites, 
almost everywhere on [0,r], 

G{t)u{t)^b{t), (2.7) 

with b{t) := -(/iio(0)isSi^m- 

Note that, if G{t) is invertible, then u{t) is uniquely determined by Equation 



(2.7). This only occurs for m even. 

If m is odd, G{t) is never invertible. However, a similar construction is derived 
as follows. Define 

G{t)---{h^Mo^.,^^- (2-8) 

Since G{t) is skew-symmetric, the determinant of G{t) is the square of a polynomial 
P{t) in the hij(t) with degree (m -I- l)/2, called the Pfaffian (see of G{t) From 



Equation (2.5), G{t) is not invertible, and thus, along the extremal, P(t) — 0. After 



differentiation, one gets, almost everywhere on [0,T], 

m 

{P,ho}{t) + J2u,{t){P,h,}{t) = 0. (2.9) 



1=1 



Define the (rn+1) x m matrix G{t) as G{t) augmented with the row ({P, hj}{t))i^j^„i, 
and the (TO-l-l)-dimensional vector b{t) as b{t) augmented with the coefficient —{P, /io}(i)- 



Then, from Equations (2.7) and ( |2.9| ), there holds, almost everywhere on [0,T], 

G{t)u{t) =^b{t). (2.10) 



If G(t) is of rank to, then u{t) is uniquely determined by Equation (2.10) 



These facts, combined with Remark 2.2, motivate the following definition 



Definition 2.5. If m is even (resp. odd), a singular trajectory x{-) is said to be 
of minimal order if: 

(i) x{t) = 0, for almost every t G Idep{x{-)); 

(a) it admits an abnormal extremal lift such that, for almost every t £ [0, T] \Idep, 
rank G{t) — m if m is even, resp., rank G{t) = m if m is odd. 

On the opposite, for arbitrary to, a singular trajectory is said to be a Goh trajec- 
tory if it admits an abnormal extremal lift along which the Goh matrix is identically 
equal to 0. 

Theorem 2.6. Let m < n be a positive integer. There exists an open and 
dense subset Om+i of VF{M)"^^^ so that, if the (to + l)-tuple (/o, . . . , fm) belongs to 
Om+i, then every nontrivial singular trajectory of the associated control- affine system 
x(t) — /o(a;(t)) -f '^^iUi{t)fi(x{t)), is of minimal order and of corank one. In 
addition, for every integer N , the set Om+i can be chosen so that its complement has 
codimension greater than N . 



Corollary 2.7. With the notations of Theorem 2A. and if m ^ 2, there exists an 
open and dense subset Om+i ofVF{MY"'^^ so that every control- affine system defined 
with an (to + l)-tuple of 0„i+i does not admit nontrivial Goh singular trajectories. 

5 



2.3. Minimizing singular trajectories. We keep here the notations of the 
previous sections. Consider the control-afhne system 



x{t) ^ fo{x{t)) + Y,uMMx{t)), (2.11) 



and the quadratic cost given by 



CuAT,u) = ^J^ (u{tfU{x{t))u{t)+g{t,x{t)))dt, (2.12) 



where U e 5+(M) and 5 e C°°(R x M). Here, S+{M) denotes the set of smooth 
mappings x t-^ U (x) on M, taking values in the set of m x m real positive definite 
matrices. 

For xo 6 M and T > 0, define the optimal control problem 

mi{Cu,g{T, u) I E,,^t{u) = x}. (2.13) 

We next state two sets of genericity results, depending whether the cost or the control 
system is fixed. 

2.3.1. Genericity w.r.t. the control system, with a fixed cost. 

Proposition 2.8. Fix U e 5+(M) and g G C°°(R x M). There exists an open 
and dense subset Om+i of VF{M)™~^^ such that every nontrivial singular trajectory 
of a control- affine system defined by an {m + l)-tuple of Om+i is strictly abnormal 



for the optimal control problem (2. IS) 



Corollary 2.7 together with Proposition 2.8 yields the next corollary. 
Corollary 2.9. Fix U G S+{M) and g e C°°{R x M). Let m ^ 2 be an 
integer. There exists an open and dense subset 0,„+i of FF(M)™+i so that the 



optimal control problem ( 2. IS ) defined with an {m + l)-tuple of 0„i+i does not admit 
nontrivial minimizing singular trajectories. 

Remark 2.10. In both previous results, the set Om+i can be chosen so that its 
complement has arbitrary codimension. 

2.3.2. Genericity w.r.t. the cost, with a fixed control system. We endow 
S+{M) with the Whitney topology. An (to+ 1)- tuple (/o, . . . , /„,) of VF{MY''+^ is 
said to verify the Lie Algebra Rank Condition if the Lie algebra generated by /o, . . . , fm 
is of dimension n at every point of M. 

Proposition 2.11. Fix (/o, ...,/„) G VF{M)"^+'^ so that the Lie Algebra Rank 
Condition is satisfied and the zero control u = is not singular. Let g G C°°(K x 
M). Then, there exists an open and dense subset Am of S^{AI) such that every 
nontrivial singular trajectory of the control- affine system associated to the (m + 1)- 



tuple (/o, . . . , fm) is strictly abnormal for the optimal control problem (2. IS ) defined 
with U G Am and g . 

Assuming that the zero control u = is not singular is a necessary hypothesis. 
Indeed, the fact that a control u is singular is a property of the sole (m + l)-tuple 
(fa, ■ ■ ■ , fm) and is independent of the cost. On the other hand, every trajectory 
x :— x{-,xo,0) associated to the zero control is always t he pr ojection of the normal 



extremal (a;(-),0, —1,0) of any optimal control problem ( 2.13 ). As a consequence, if 
the zero control is singular, such a trajectory x{-,xo,0) cannot be strictly abnormal. 
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In order to handle the case of a singular zero control, it is therefore necessary to 
consider more general quadratic costs such as 

Cc/.o.<,(r,u) = (^-u{tfU{x{t))u{t)+a{x{t)fuit)+g{t,x{t))yt, (2.14) 

where U G S+{M), a e C°°(M,M™) and g £ C°°(M x M). 

Proposition 2.12. Fix (/o,...,/m) G VF(M)™+^ satisfying the Lie Algebra 
Rank Condition and g G C°°(R x M). Then, there exists an open and dense subset 
Bm of S^{M) X C°°{M,]SJ") such that every nontrivial singular trajectory of the 
control- affine system associated to the (m + l)-tuple (/q, . . . , /,«) is strictly abnormal 
for the optimal control problem (2.11)-(2.14) defined with (U,a) G Bm and g. 

2.4. Driftless control-affine systems. Let T be a positive real number. Con- 
sider the driftless control-affine system 

m 

i:(t)=^u,(i)/^(x(t)), (2.15) 

i=l 

where (/i, . . . , /,„) is an m-tuple of smooth vector fields on M, and the set of admis- 
sible controls u — (ui, . . . , Um) is an open subset of L°°{[0, T], 17). 

For every trajectory x{-) := x{-,xo,u) of (2.1), define /dcp(2:(-)) as the closed 
subset of [0, T] 

/dcp(a;(-)) :={iG [0,T] | rank{/i(a;(t)), . . . , /„,(a;(i))} < m}. 

Theorem 2.13. Let m ^ n be a positive integer. There exists an open and 
dense subset Om of VF{M)"^ so that, if the m-tuple (/i, . . . , /„) belongs to Om, then 
every trajectory x{-) of the associated driftless control-affine system x = ""i/iC^^) 
verifies 

i(i) = 0, for a.e. t G /dcp(a;(-))- 

In addition, for every integer N , the set 0,„ can be chosen so that its complement has 
codimension greater than N . 

2.4.1. Singular trajectories. Let x{-) be a singular trajectory, projection of 
an abnormal extremal (a;(-), A(-)). Similarly to the previous section, we define, for 
t G [0, T] and i, j G {1, . . . , m}, 

h,{t) {X{t)J,{x{t)), KAt) [f^,fJ]{x{t))). 
For every t G [0,T], 

h,{t) = Q, i = l,...,m. (2.16) 



Differentiating ( 2.16 ), one gets, almost everywhere on [0,r], 

m 

Y,h,,{t)u,{t)^Q, iG{l,...,m}. (2.17) 

i=i 

Definition 2.14. Along an abnormal extremal (x(-), A(-), u(-)) of the system 
(2.1), the Goh matrix G{t) at time t G [0,T] is the m x m skew- symmetric matrix 
given by 

G(t):=(/^.,(0)i^,,^„. (2.18) 
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Since G(t) is skew-symmetric, rank G{t) is even, and Equation (2.17) rewrites, 
almost everywhere on [0, T], 



G{t)u{t) = 0. (2.19) 

Note that, if rank G{t) = m — 1, one can deduce from ( ^.19| ) an expression for 
u{t), up to time reparameterization. This only occurs for m odd. 

If m is even, rank G{t) is always smaller than m — 1. However, a similar construc- 
tion is derived as follows. The determinant of G{t) is the square of the Pfaffian P{t), 
and, along the extremal, P{t) = 0. After differentiation, one gets, almost everywhere 

on [o,r], 

m 

J2Mt){P,h,}{t)^0. (2.20) 

1=1 

Define the (m-f 1) x m matrix G{t) as G {t) augmented with the row ({P, hj}{t))i^j^m- 
Then, from Equations ( 2.19| ) and ( 2.20| ), there holds, almost everywhere on [0, T], 



G{t)u{t) = 0. (2.21) 



If G{t) is of rank to — 1, one can deduce from ( ^.21 ) an expression for u{t), up to time 
reparameterization. 

Definition 2.15. If m is odd (resp. even), a singular trajectory x{-) is said to 
be of minimal order if: 

(i) x{t) — 0, for almost every t G Idepix{-)); 

(ii) it admits an abnormal extremal lift such that, for almost every t G [0, T] \ Idep, 
rank G{t) = to — 1 if m is odd, resp., rank G(t) — m ~ 1 if m is even. 

On the opposite, for arbitrary m, a singular trajectory is said to be a Goh trajec- 
tory if it admits an abnormal extremal lift along which the Goh matrix is identically 
equal to 0. 

Theorem 2.16. Let m be an integer such that 2 ^ m ^ n. There exists an 
open and dense subset Om ofVF{M)"^ so that, if the m-tuple (/i, . . . , fm) belongs to 
Om, then every nontrivial singular trajectory of the associated driftless control- a ffine 
system x{t) = X^Tii '^i{'t).fi{^{'t)) ^■s of minimal order and of corank one. In addition, 
for every integer N , the set Om can be chosen so that its complement has codimension 
greater than N . 



Corollary 2.17. With the notations of Theorem 2.16 and if m ^ 3, there exists 
an open and dense subset Om ofVF[M)™' so that every driftless control- affine system 
defined with an m-tuple of 0,„ does not admit nontrivial Goh singular trajectories. 

2.4.2. Minimizing singular trajectories. Consider the optimal control prob- 
lem associated to the driftless control-affine system 

m 

i(i)=^u,(t)/,(x(i)), (2.22) 

2=1 

with the quadratic cost given by 

Cu,g{T. ") = 2 X {<tfU{x{t))u{t) + g{t, x{t))) dt, (2.23) 



where U G S+{M) and 5 G C°°(R x M). 

For xq ^ M and T > 0, define the optimal control problem 

mi{Cu,giT,u) I i;,„,T(") = x}. (2.24) 

We next state genericity results with respect to the control system, with a fixed cost. 

Proposition 2.18. FixU € S+{M) and g G C°°(U. x M). There exists an open 
and dense subset Om of VF{M)™' such that every nontrivial singular trajectory of a 
driftless control- affine system defined by an m-tuple of Om is strictly abnormal for the 
optimal control problem ( 2.2^ ). 



Corollary 2.17 together with Proposition 2.18 yields the next corollary. 
Corollary 2.19. FixU e S+{M) and g e C°° (Rx M) . Let m ^ 3 be an integer. 
There exists an open and densee subset Om of VF{M)"^ so that the optimal control 



problem (2.24) defined with an m-tuple of Om does not admit nontrivial minimizing 
singular trajectories. 

Remark 2.20. In both previous results, the set Om can be chosen so that its 
complement has arbitrary codimension. 

We also have have a genericity result with respect to the cost, with a fixed control 
system. 

Proposition 2.21. Fix (/i, . . . ,/„) G VF{M)"'- so that the Lie Algebra Rank 
Condition is satisfied. Let g G C°°(R x M). Then, there exists an open and dense 
subset Am of Sm{M) such that every nontrivial singular trajectory of the driftless 
control- affine system associa ted t o the m-tuple (/i,...,/m) is strictly abnormal for 



the optimal control problem ( 2.24 ) defined with U G Am o,nd g. 

Remark 2.22. In the driftless case, the control u = is always singular, but 
corresponds to a trivial trajectory. Therefore, in opposition to the control- affine case, 
it is not necessary to add the linear term a{x)'^u in the cost. 

3. Consequences. 

3.1. Regularity of the value function. Consider the optimal control problem 
(2.13), associated to the control-afhne system (2.11) and the cost ( ^.12| ). The value 



function is defined by 

Sxo,t{x) inf{C(7,g(r,w) | Ex^.tIu) = x}, (3.1) 

for every x G K." (with, as usual, inf := —00). We assume in the sequel that all data 
are analytic. 

The regularity of Sxo,t is closely related to the existence of nontrivial minimizing 
singular trajectories starting from xq. It is proved in that, in the absence of 
minimizing singular trajectories, the value function is continuous and subanalytic 
(see e.g. [|l6| for a definition of a subanalytic function). For driftless control-affine 
systems and g = 0, the value function coincides with the square of a sub-Riemannian 
distance (see Q for an introduction to sub-Riemannian geometry). In particular, in 
this case, the value function is always continuous, but the trivial trajectory x(-) = xq 
is always minimizing and singular. Moreover, if there is no nontrivial minimizing 
singular trajectories, then the value function is subanalytic outside xq (see |3| Q). 
This situation holds for generic distributions of rank greater than or equal to three 
(see I, 0). 



The results of Section |2.3| have the following consequence on the regularity of 

Sxo,T- 



Corollary 3.1. With the notations of Corollary 2.i, and if in addition the 
functions g, U, and the vector fields of the (m + l)-tuple in Om+i o,re analytic, then 
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the associated value function S^o.t ^•s continuous and subanalytic on its domain of 
definition. 

Remark 3.2. If there exists a nontrivial minimizing trajectory, the value function 
may fail to be subanalytic or even continuous. For example, consider the control- affine 
system in given by 

x{t) = 1 + y{tf, y{t) = u{t), 

and the cost C{T,u) — u{t)^dt. The trajectory {x{t) — t,y{t) — 0), associated 
to the control u = 0, is a nontrivial minimizing singular trajectory, and the value 
function >5'(o,o).T '"Js asymptotic expansion, near the point (T,0), 

^ , , 1 f y' \^ f y' f y' 

5(o.o),t(x, y) = + ^ cxp [-—^ j + o ^ exp (^-— -^^ 

(see for details). Hence, it is not continuous, nor subanalytic, at the point (T, 0). 



In the driftless control-affine case, by using results of Section 2.4.2, we derive the 
following similar consequence. 



Corollary 3.3. With the notations of Corollary 2.1i, and if in addition the 
functions g, U , and the vector fields of the m-tuple in Om ire analytic, then the 
associated value function Sxo,t is subanalytic outside xq. 

3.2. Regularity of viscosity solutions of Hamilton- Jacobi equations. As- 
sume that the assumptions of the previous subsection hold. It is standard (see jisl, [T7|) 
that the value function v(t, x) = Sxo,t{x) is a viscosity solution of the Hamilton- Jacobi 
equation 

dv ( dv \ 

n[x,— ]^g{t,x), (3.2) 



dt \ dx 

where nix,p) = {p, foix)) + \ Erj=i(t^"^W)y (P- hix)){P^ fji^))- 

Conversely, the viscosity solution of ( ^.2[ ) with analytic Dirichlet-type conditions is 
subanalytic, as soon as the corresponding optimal control does not admit minimizing 
singular trajectories (see Q). Using the results of the previous sections, this situation 
holds generically if m ^ 2 (and, similarly for driftless control-afhne systems, if m ^ 3). 

As a consequence, the analytic singular set Sing('i;) of the viscosity solution 
i.e., the subset of R" where v is not analytic, is a (subanalytic) stratified manifold of 
codimcnsion greater than or equal to one (see |2^ for more details on the subject). 
Since Sing(ti) is also the locus where characteristic curves intersect, the abovemen- 
tioned property turns out to be instrumental for the global convergence of numerical 
schemes for Equation ( |3.2| ) (see [0). Indeed, the analytic singular set must be as 
"nice" as possible in order to integrate energy functions on the set of characteristic 
curves. 

3.3. Applications to stabilization and motion planning. For a driftless 
control-affine system verifying the Lie Algebra Rank Condition, there exist general 
stabilizing strategies stemming from dynamic programming. As usual, the stabilizing 
feedback is computed using the gradient of the value function S for a suitable optimal 
control problem. Of course this is only possible outside the singular set Sing(S'), and 
one must device another construction for the feedback on Sing(S'). Let us mention two 
such strategies, the first one providing an hybrid feedback (se e 122| ), and the second 
one a smooth repulsive stabilizing (SRS) feedback (see [g^, |24[|). Both strategies 
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crucially rely on the fact that Sing(S') is a stratified manifold of codimension greater 
than or equal to one. 

As seen before, the latter fact holds generically in the analytic category for m ^ 3. 

On the other hand, the absence of singular minimizing trajectories is the basic 
requirement for the convergence of usual algorithms in optimal control (such as direct 
or indirect methods, see e.g. |o)). We have proved that this situation holds 
generically for control- affine systems if m ^ 2, and for driftless control-affine systems 
if m 5^ 3. 

As a final application, consider a driftless control-afhne system verifying the Lie 



Algebra Rank Condition. According to Proposition 2.21, it is possible to choose a 
(generic) cost function C(To such that all singular trajectories are strictly abnormal. 
Combining that fact with |2^, Theorem 1.1], we deduce that there exists a dense subset 
N of M" such that every point of N is reached by a unique minimizing trajectory, 
which is moreover nonsingular. As a consequence, a shooting method with target in 
N will converge. That fact may be used for solving (at least approximately) motion 
planning problems. 

4. Proofs of the results. 



4.1. Proof of Theorem |2.lj and of Theorem 2.13. Every trajectory of the 



control-afhne system i = fo{x) + J^iLi'^ifii^) is also a trajectory of the driftless 



control system x = '^iLo'^ifii^)^ with uq = 1. Therefore, Theorem 2T follows from 



Theorem 2.13, whose proof is provided next. 



Let x(-) — x{-,xo,u) be a trajectory of the driftless control system i = '^i=i'^ifi{^) 



with 2 ^ m ^ n. Consider the set /dcp(a;(-)) defined by (2^). We argue by contrapo- 
sition, and assume that /dcp(a;(-)) contains a subset / of positive measure such that 
x{t) ^ for t £ I. Since Lebesgue points of u are of full Lebesgue measure, we assume 
that u is continuous on /. 

Up to considering a subset of /, and relabeling the /i's, we assume that, for every 
t € I: 

(i) there exists 1 ^ fc < to such that 



k{h{x{t)),...J„,{x{t))}^k; 



ran 

(ii) fi{x(t)), . . . , fk{x{t)) are linearly independent, and thus, there exist real num- 
bers aj{t), i — 1, . . . ,k, j — k + 1, . . . ,m, such that 

k 

fj{x{t))=Y,^lit)M^it))^ j = fc + l,...,m. 

k m 

Therefore, i(t) = ^ Si{t)f.,{x{t)), where S,{t) ■= u,{t) + ^ ai{t)uj{t); 

i=l j=k+l 

(iii) (5i(t) ^0. 

Remark 4.1. Up to reducing I, we furthermore assume that I is contained in 
an open interval X on which rank{/i(a;(i)), . . . , fk(x(t)y\ = k. 

Set ad° g{h) = h, where g,h £ VF(M), and &d^g{h) ^ [g, ad''"^g(/i)] for k ^ 1. 
The length of the iterated Lie bracket [/ii , [/ia , [• • • , /ik ] • ■ • ] of /i , . . . , /m is the integer 
k. 

Proposition 4.2. Let N be a positive integer. There exists a subset J^r C I of 
positive measure such that, for every t £ Jj^, and every £ £ {1, . . . , N}, 

5i(t)^-iad^-Vi(/™)(x(t)) = hi{x{t)) + Ri{x{t)), (4.1) 
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where 

• h't{x{t)) G Span{/i(a;(t)), . . . , 



• Rf is a linear combination of iterated Lie brackets of fi, . . . , fm, of length 
smaller than £—1, and of iterated Lie brackets of fi, . . . , fk, of length smaller 
than or equal to £. 
Proof. For t e L, let Ft £ VF{M) be the vector field defined by 



Ftix) :=^<5.(^)/^(a:). 



i=l 

Notice that i{t) = Ft{x{t)), for t E I. For the argument of Proposition [4.2| , we need 
the following lemma. 

Lemma 4.3. Consider a set J d I of positive measure and h G VF(AI) so that 
h{x{t)) G Span{/i(a;(t)), . . . , /fc(a;(f))} on J, i.e., for every t G J, there exist real 
numbers f3i(t), i — 1, . . . , k, such that 



h{x{t)) = Y,mh{<t)). (4.2) 

i=l 

For t G J, define gt G VF{M) by 

k 

gt{x) ■.^h{x)-Y,P,{t)f,{x). 

Then, there exists a set J' C J of positive measure such that 

[Ft,gtKx{t))eSpai-i{fi{x{t)),...,fk{x{t))} on J'. (4.3) 



Proof. [Proof of Lemma 4.2] Using Remark [4.l| , there exist ej G VF{AI), fc + 1 ^ 
j ^ n, so that, for every t G X, the vectors fi{x{t)), . . . , fk{x{t)), ek+i{x{t)) , . . . , 
en{x{t)) span T^(^t^M. Thus, there exist n smooth functions bi, 1 ^ i ^ n, defined on 
M, such that 



h{x) ^'^bi{x)fi{x) + ^ bi{x)ei{x), 



1=1 i=k+l 

for X in an open neighborhood of x{I). For i — 1, . . . ,n, define /3i(i) := bi{x{t)), for 
t £ X (this notation is consistent with ([4.2])). The /3^s are absolutely continuous on X 
and differentiable everywhere on J. For i = fc + 1, . . . , n, there holds (3i = on J and 
therefore, it follows that /3i = on a subset J' C J of full measure (cf. |2^, Lemma 
p. 177]). 

For t G J, using that gt{x{t)) = 0, and Ft{x{t)) = x{t), it holds 
[Fugt](x{t))^dgtoFt{x{t)) 

k n 

= Y,{dh{x{t)).x{t))f,{x{t)) + {dh{x{t)).x{t))eMt)) 

k n 



Y,mfMt))+ J2 ftWe.(x(t)). 



i=k+l 
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On J', the second sum of the right-hand side of the last equation vanishes, and the 
lemma follows. □ 



Applying Lemma 4.3 to ft, = /,„ and J = I, we get 



[Ft,gl]ix{t))eSpa.n{h{x{t)),...Jk{x{t))} on Ji, 

where Ji C / and gj := - X^Li 

Set h] = [Ft,gl]. We next iterate the above procedure, for 1 ^ £ ^ N . Assume 
that the vector fields hf, gf, and the set Ji of positive measure are defined, such that 
hi{x{t)) G Span{/i(x(i)), . . . , fk{x{tj)} on Ji. For every t e Ji, let (3f{t), i = l,...,k, 
be the real numbers such that 

k 

hi{x{t)) = Y,Pl{t)fMt)). 

i=l 

and define gl+^ E VF{M) by g[+^ - Set hl+^ := [Fugl+\ 

Applying Lemma there exists a subset Ji+i C Jt of positive measure such that 
h'+\x{t)) e Span{/i(a;(i)), . • . , fk{x{t))} on J,+i. 

For t e Jat, and for £ = 1, . . . , iV, we express hl{x{t)) using iterated Lie brackets 



of /i, . . . , /m, and an easy induction yields (4.1). 



Combining Proposition 4.2 with routine transversality arguments (see for instance 
L2| and Q), it follows that the (m + l)-tuple (/o, . . . , fm) belongs to a closed subset 



of yF(M)™+^ of codimension greater than or equal to A^. Theorem 2.13 follows 



Remark 4.4. The fact that fi{x(t)) ^ is essential in order to derive, from 

(4-1), o,n infinite number of independent relations, and then to apply the abovemen- 



tioned transversality arguments. 



4.2. Proof of Theorem 2.6. The minimal order and corank one properties are 
proved separately in the following lemmas. 

Lemma 4.5. There exists an open and dense subset O^+i ofVF{M)"^^^ so that, 
if the (to + l)-tuple (/o, . . . ,/m) belongs to 0^+1, then every singular trajectory of 
the associated control- ajjine system x{t) = /o(2^(0) + f^i(t)fiix(t)) is of minimal 

order. In addition, for every integer N, the set O^j+x '^'^^ chosen so that its 
complement has codimension greater than N . 

Lemma 4.6. There exists an open and dense subset Om+i of Om+i so that, if 
the (m + l)-tuple (/q, . . . , fm) belongs to Om+i, then every nontrivial singular trajec- 
tory of the associated control- affine system x{t) = fo{x{t)) + X^I^i Ui{t)fi{x{t)) is of 
corank one. In addition, for every integer N , the set Of^_^_i can be chosen so that its 
complement has codimension greater than N . 



The conclusion of Theorem 2.6 with the set 0„i+i whose existence is stated above. 



4.2.1. Proof of Lemma |4.5| . From Theorem ^4|, there exists an open and dense 
subset Ol^^i of yF(Af)™+^ such that, if (/o, . . . , fm) G O^+i; then every trajectory 
x{-) of i = fo{x) + Uifi{x) verifies Item (i) of Definition ^.5[ 

It is therefore enough to show the existence of an open and dense subset 0^_^i 
of VF{M)™-^^ such that, if (/o, . . . , fm) G then every singular trajectory x(-) 



of i = fo{x) + X^i" 1 '^ifi{x) verifies Item (ii) of Defi nition 2.5. Then, by choosing 
Om+i ■— Omj^i n Om+i, the couclusion of Lemma 4^ follows. 



Consider a singular trajectory x{-) := x(-,a;o,u) of i = /o(a^) + X]"=i '"i/2(^)> 
admitting an abnormal extremal (a;(-), A(-)). Assume that there exists J C [0,T] \ 
Idep{x{-)) of positive measure such that G(t) is not of rank m if to is even, respectively, 

13 



G{t) is not of rank m if m is odd. We will show that the (m + l)-tuple (/q, . . . , fm) be- 
longs to a subset of arbitrary codimension in VF{M)"^^^ whose complement contains 
an open and dense subset. 

Note that, on [0, T] \ Idep{x{-)), the vector fields fo{x{t)), . . . , fm{x{t)) are hn- 
early independent. The remaining part of the argument consists of reformulating 
the problem in order to follow the chain of arguments in the proof of [ p^ Theorem 
2.4] concerning the case of everywhere linearly independent vector fields. For that 
purpose, we distinguish the cases m even and m odd. 



Assume first that m is even. As in (2^), define, for t £ J, G{t) := {hij{t))^ 



From (2.7), we have, for t € J, 



G{t) 



{G{t)uit)y 
-G{t)u{t) G{t) 



Since the ranks of both G(t) and G{t) are even, they must be equal, for t £ J, and 
hence, the rank of G{t) is smaller than m on J. This is exactly the starting point of the 
proof of Lemma 3.8]. The machinery of then applies and we deduce that the 
(rn-l- l)-tuple (/o, . . . , fm) belongs to a subset of arbitrary codimension in FF(M)"'+^ 
whose complement contains an open and dense subset O^+i of yF(M)™+^. 

Assume next that m is odd. Define the (m + 2) x (m + 1) matrix G{t) as G{t) 
augmented in the last row with ({P, hj}{t))o<^j^m- 

Lemma 4.7. With the notations above, rank G{t) ^ rank G{t) + 1. 

Proof. It amounts to show that, ^ e kerG'(<) implies (0,^) £ ker G{t). This 
follows from the fact that if G{t)(^ — 0, then G{t)^ = 0, and thus ^ is orthogonal to 
the range of G{t) since G{t) is skew-symmetric. □ 



Using Lemma 4.7, the rank of G{t) is less than m -I- 1 on J. This is exactly the 
starting point of the proof of Lemma 3.9]. The machinery of iQ then applies 
and we deduce that the (m + l)-tuple (/o, . . . , fm) belongs to a subset of arbitrary 
codimension in VF{M)^"'^^ whose complement contains an open and dense subset 
Oi?+i of VF{M)^+\ 

4.2.2. Proof of Lemma |4.6| . We argue by contraposition. Consider a nontrivial 
singular trajectory x{-) := x{-,Xo,u) oi x = /o(a;) ^ifiix), with (/o, ■ ■ ■ , fm) ^ 

0]j^j^i. Assume that x{-) admits two abnormal extremal lifts (x(-), A^^' (•)) and A^^' (•)) 
such that, for some to G [Oj^]j '^'^'(^o) and A[^l(to) are linearly independent. By lin- 
earity, AI^I(-) and A[^1(-) are linearly independent everywhere on [0,r]. Since x{-) is 
nontrivial, it follows from Remark |2.3| that there exists a nonempty subinterval J of 
[0,T] \ Idep{x{-)). We are now in a position to exactly follow the arguments of 
corresponding to the corank one property, i.e., Lemma 4.4]. 



4.3. Proof of Theorem 2.16| . We start with the proof of the statement dealing 



with the minimal order property. 



From Theorem 2.13, there exists an open and dense subset O^^ of VF{M)"^ such 
that, if £ Oi ,, then every trajectory x{-) of i = Yl^^^iU^fiix) verifies 



Item (i) of Definition 2.15 



It is therefore enough to show the existence of an open and dense subset of 
VF{M)"^ such that, if (/i, . . . , fm) & O^, then every singular trajectory x(-) of x 



S"=i '^ifi{^) verifies Item (ii) of Definition |2.15| . Then, by choosing Dm '■ — 0,^„ flO^^ 
the statement dealing with the minimal order property in Theorem ^.16 follows. 
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Consider a singular trajectory x{-) :— x{-,X(),u) of i; = X]i=i admitting 
an abnormal extremal (a;(-), A(-)). Assume that there exists J C [0,T] \ Idep{x{-)) of 
positive measure such that G{t) is not of rank m — 1 if m is odd, respectively, G(t) 
is not of rank m — 1 if m is even. Following exactly the proofs of Lemmas 3.8 and 
3.9 in the m-tuple (/i, . . . , fm) belongs to a subset of arbitrary codimension in 
Fi^(M)™ whose complement contains an open and dense subset. 

We proceed similarly for an argument of the statement dealing with the corank 
one property. 

4.4. Proofs of Propositions 2.8 and |2.18 . We only treat the control-affine 
case, the argument for the driftless control-affine case being identical. We argue 
by contraposition. Consider a nontrivial singular trajectory x(-) := x{-,xo^u) of 
X = /o(x) + Utft{x), with (/o, . . . , /™) e Assume that x(-) admits 

on the one part a normal extremal lift (x(-), A^"' (•)) and on the other part an abnormal 
extremal lift (x(-), AI'^I (•)). 

Let us introduce some notations. For k E N, let L = li ■ ■ ■ Ik be a multi-index of 
{0, . . . , to}. The length of L is \L\ — k and is the vector field defined by 

/l := [[■ • • [fhJh], ■■■], /ij- 

A multi-index L — jl ■ ■ ■ I with k consecutive occurrences of the index I is denoted as 
L=jlK 

For every multi-index L of {0, ... , m} and t e [0, T], set 

h^^\t)^{Xi-\t)jL{xm, and h^l\t)^{Xi^\t)JUxm- 
After time differentiation, we have on [0, T], 

d 



dt 

d 
di 



1=1 



1=1 



(4.4) 
(4.5) 



Recall that, according to the Pontryagin Maximum Principle, there holds 









uit) = 


: = Uixit))-' 






\U„^{t)J 





(4.6) 



and, for every i e [0,T], 



h^^\t) = constant, h^^\t) = 0, 



(4.7) 



for every / £ {1, . . . , m}, and t G [0, T]. Since the trajectory x(-) is nontrivial, there 
exists an open interval J C [0,T] and i G {0, . . . ,to} such that Ui{-)fi{x{-)) is never 
vanishing (with the convention uq = 1). Fix j G {0, . . . ,to} \ {i}. Differentiating s 
times (with s ^ 1) the relation h'^^\t) = constant with respect to i G J, one gets, by 
using (O), (O), and (O), that 



dt 



(4.8) 
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where Rs{t) is polynomial in h^2\t) and /i^'(i), \L\ ^ s, \K\ ^ s + 1, with A' different 
from ji* and iji''^^. Fix t ^ J . Since ^ and fi{x{t)) ^ 0, we are in a position to 
apply routine transversality arguments. It follows that the (m + l)-tuple (/o, . . . , /m) 
belongs to a closed subset of yF(M)'"+^ of arbitrary codimension. Proposition |2.8| 
follows. 



4.5. Proofs of Propositions |2.1l| , ^.12| , and 2.21. We first prove Proposition 



2.12 and argue by contraposition. Consider a nontrivial singular trajectory x(-) 
a;(-,a;o,w) of i = /o(a;) + X^IILi Assume that x[-) admits on the one part a 
normal extremal lift (x(-), A'"' (•)) and on the other part an abnormal extremal lift 
(x(-),AH(-)). 

From the Pontryagin Maximum Principle, there holds, for I — 1, . . . , m, 

where the Q'^(x) and the ap(x) are respectively the coefficients of ?7~^(a;) and of 
a(x). Note that the uj's are smooth functions of the time. 

Since the trajectory a;(-) is nontrivial, there exists an open interval J C [0, T\ such 
that i is never vanishing on J and one of the two following cases holds. 

Case 1: u = on J. 

In that case, — fo{x(t)) for t E J, and fo{x{-)) is never vanishing on J. 
Moreover, for p = 1,...,to, /3p = on J, i.e. ap{x{t)) — h^p\t) for t e J. By 
differentiating the latter relation with respect to the time, we deduce that, for all 
N ^ 0, t £ J and p = 1, . . . , m, 

where i/„ denotes the Lie derivative with respect to the vector field /q. Apply- 
ing routine transversality arguments, it follows that a belongs to a closed subset of 
C°°(M, R™) of arbitrary codimension. 

Case 2: u is never vanishing on J. 

Using ( |2.4| ) and the Lie Algebra Rank Condition, there exist a multi-index L, an 
index jo e {0, . . . , m}, and a subinterval of J (still denoted J), such that 

/i^'(i) = constant, and h'^L^git) 0, 

for every t G J. Differentiating /i^' on J, one gets 



/=1 



(4.9) 



where cu{t) A(041 and Qp(t) := /3p(i)41 W + W^tW if ' < 

Lemma 4.8. Up to reducing the interval J , there exist indices j and I in {1, ... , m} 
such that cij{t) or Cji(t) is never vanishing on J. 

Proof. If jo = 0, then h^ll(t) ^ 0, and it follows from (4.9) that there exist 



l,j G {!,..., m} such that cij(t) ^ 0. Otherwise, take j := jo. In that case, one 
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of the /3p's does not vanish on J since u is not zero. First, assume that (3j{t) is not 
identically equal to zero on J; then, up to reducing J, Cjj(t) is never vanishing on J. 
Otherwise, there exists I ^ j such that, up to reducing J, /?/ is never vanishing on J 
and thus similarly for c/j (or Cji). □ 

For te J, let Ft £ VF{M) be the vector field defined by 

?n 

Ft{x) :=/o(x)+^u,W/,(x). 

Notice that Ft{x{t)) = i{t) ^ 0. For aU ^ and t e J, we get, by taking the 
{N + l)-th time derivative of ft,^' on J, 

where RN{t) is a linear combination of Lp^QP^{x{t)), with s ^ N, p ^ i in {1, . . . , m} 
and s < if {p,i) = and of L''^^QP''{x{t)), with s < A^, p < i in {1, . . . ,r7i}, 

and r e {0, . . . , m}. Applying routine transversality arguments, it follows that {U, a) 
belon gs to a closed subset of 5+(Af) x C°°(M, R™) of arbitrary codimension. Propo- 
sition |2.12| is proved. 



To show Propositions 2.11 and 2.21 , simply notice that the argument of Case 2 



with a = applies with suitable modifications. 
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